Reinforcement Learning for Cyber-Physical Systems: with Cybersecurity Case Studies was inspired by recent developments in the fields of reinforcement learning (RL) and cyber-physical systems (CPSs). Rooted in behavioral psychology, RL is one of the primary strands of machine learning. Different from other machine learning algorithms, such as supervised learning and unsupervised learning, the key feature of RL is its unique learning paradigm, i.e., trial-and-error. Combined with the deep neural networks, deep RL become so powerful that many complicated systems can be automatically managed by AI agents at a superhuman level. On the other hand, CPSs are envisioned to revolutionize our society in the near future. Such examples include the emerging smart buildings, intelligent transportation, and electric grids. However, the conventional hand-programming controller in CPSs could neither handle the increasing complexity of the system, nor automatically adapt itself to new situations that it has never encountered before. The problem of how to apply the existing deep RL algorithms, or develop new RL algorithms to enable the real-time adaptive CPSs, remains open. This book aims to establish a linkage between the two domains by systematically introducing RL foundations and algorithms, each supported by one or a few state-of-the-art CPS examples to help readers understand the intuition and usefulness of RL techniques. Features Introduces reinforcement learning, including advanced topics in RL Applies reinforcement learning to cyber-physical systems and cybersecurity Contains state-of-the-art examples and exercises in each chapter Provides two cybersecurity case studies Reinforcement Learning for Cyber-Physical Systems with Cybersecurity Case Studies is an ideal text for graduate students or junior/senior undergraduates in the fields of science, engineering, computer science, or applied mathematics. It would also prove useful to researchers and engineers interested in cybersecurity, RL, and CPS. The only background knowledge required to appreciate the book is a basic knowledge of calculus and probability theory.

Reinforcement Learning for Cyber-Physical Systems: with Cybersecurity Case Studies was inspired by recent developments in the fields of reinforcement learning (RL) and cyber-physical systems (CPSs). Rooted in behavioral psychology, RL is one of the primary strands of machine learning. Different from other machine learning algorithms, such as supervised learning and unsupervised learning, the key feature of RL is its unique learning paradigm, i.e., trial-and-error. Combined with the deep neural networks, deep RL become so powerful that many complicated systems can be automatically managed by AI agents at a superhuman level. On the other hand, CPSs are envisioned to revolutionize our society in the near future. Such examples include the emerging smart buildings, intelligent transportation, and electric grids. However, the conventional hand-programming controller in CPSs could neither handle the increasing complexity of the system, nor automatically adapt itself to new situations that it has never encountered before. The problem of how to apply the existing deep RL algorithms, or develop new RL algorithms to enable the real-time adaptive CPSs, remains open. This book aims to establish a linkage between the two domains by systematically introducing RL foundations and algorithms, each supported by one or a few state-of-the-art CPS examples to help readers understand the intuition and usefulness of RL techniques. Features Introduces reinforcement learning, including advanced topics in RL Applies reinforcement learning to cyber-physical systems and cybersecurity Contains state-of-the-art examples and exercises in each chapter Provides two cybersecurity case studies Reinforcement Learning for Cyber-Physical Systems with Cybersecurity Case Studies is an ideal text for graduate students or junior/senior undergraduates in the fields of science, engineering, computer science, or applied mathematics. It would also prove useful to researchers and engineers interested in cybersecurity, RL, and CPS. The only background knowledge required to appreciate the book is a basic knowledge of calculus and probability theory.

The research purpose of this book is to advance the reform of the existing international monetary system through the establishment of a new international currency standard that is a super-sovereign currency. International Monetary System provides international economic activities rules for the human society. It has significant influences not only on international economic activities of various countries but also on their domestic economic activities as well. Since the disintegration of International gold standard in 1971, studies on reform of international monetary system have remained as the important research themes for international economic research fields. Improvements of international monetary system to facilitate worldwide economic developments have been interests to all. Thus this book has valuable theoretical contributions. Since the collapse of Bretton Woods System, the current international monetary system of Jamaica System has come into being. Under Jamaica System, the sovereign currency US dollar has acted as the main international currency. This has caused vulnerability of money standard, instability of exchange rate system, and frequent occurrences of currency crises. Calls for international monetary system reforms have increased under these circumstances. Various programs such as improved international gold standard system, expansion of Special Drawing Rights, as well as establishment of single world currency surface. So this book has significant practical contributions as well. The major contribution of this book is the proposal of new scheme of establishment of supra-sovereign international currency. This is an entire new reform program that differs significantly from any past or current reform programs in international economic research fields from all over the world.

The research purpose of this book is to advance the reform of the existing international monetary system through the establishment of a new international currency standard that is a super-sovereign currency. International Monetary System provides international economic activities rules for the human society. It has significant influences not only on international economic activities of various countries but also on their domestic economic activities as well. Since the disintegration of International gold standard in 1971, studies on reform of international monetary system have remained as the important research themes for international economic research fields. Improvements of international monetary system to facilitate worldwide economic developments have been interests to all. Thus this book has valuable theoretical contributions. Since the collapse of Bretton Woods System, the current international monetary system of Jamaica System has come into being. Under Jamaica System, the sovereign currency US dollar has acted as the main international currency. This has caused vulnerability of money standard, instability of exchange rate system, and frequent occurrences of currency crises. Calls for international monetary system reforms have increased under these circumstances. Various programs such as improved international gold standard system, expansion of Special Drawing Rights, as well as establishment of single world currency surface. So this book has significant practical contributions as well. The major contribution of this book is the proposal of new scheme of establishment of supra-sovereign international currency. This is an entire new reform program that differs significantly from any past or current reform programs in international economic research fields from all over the world.